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The CENTER POR THE STUDY OP EVALUATION OF INSTRUCTIONAL 
PROGRAMS is engaged in research that will yield new ideas 
and hew tools capable of analyzing and evaluating instruc- 
tion. Staff members are creating new ways to evaluate con- 
tent of curricula, Methods of teaching and the multiple 
effects of both on students. The CENTER is. unique because 
?f its access to Southern California's elementary, second- 
ary and higher schools of diverse socio-economic levels 
and cultural backgrounds. Three major aspects of the pro- 
gram are 

Ins truct Iona 1 Variables - Research in this area 
■ will be concerned with identifying and evaluating 
' the effects of instructional variables, and with 
the development of conceptual models, learning 
theory and theory of Instruction. The research 
involves the experimental study of tne effects of 
differences in instruction as they may interact 
with individual differences among students. 

ences in community arid school environments and the 
' Interactions of both with instructional programs. 

It will als^ involve evaluating variations in stu- 
dent and teacher characteristics and administrative 
organization. 

Cri terion Measur es:- Research in this field is con- 
cerned with creating a new conceptualization of eva- 
luation cf instruction and in developing new instru- 
ments to evaluate knowledge acquired in school by 
< measuring observable changes in cognitive, affective 
and physiological behavior. It will also involve 
evaluating the cost-effectiveness of instructional 
programs. 
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An evaluation model was applied to three experimen- 
tal modes of counseling. They were compared on the basis 
of 3 interviews with respect to their affects on behavior 
moods, and feelings about counseling. 

Mode 1 counselors guided counselees in making their 
own plans for coping with problems. Mode 2 counselors 
suggested specific actions. Mode 3 counselors explored 
feelings. Three experimental counselors were trained in 
all 3 modes. 



Thirty-six subjects, student teachers who reported 
stress, were randomly assigned to counselor and mode. 
Their reactions to counseling were collected during and 
following interviews. 

It was found that a) high-stress counselees were 
more likely to continue in counseling regardless of mode; 
b) more mode 2 counselees were satisfied with their in- 
terviews; c) more mode 1 counselees actually tried the 
plans they made during interviews. 

Other findings and their implications are discussed. 
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THREE EXPERIMENTAL MODES OF COUNSELING 



Ideally, the best way to find out which of the many differ- 
ent methods of counseling are most useful would be to conduct a 
series of experiments in which different techniques were employed 
and their effectiveness compared. However, a number of obstacles 
make it difficult to conduct such experiments. 

1. There are no fully adequate measures of counselee pro- 
gress or improvement. Furthermore, counselors are not in agree- 
ment as to what kind of criterion measures are needed- -partly 
because different counselors have different goals, partly because 
some counselors are satisfied with their own subjective impres- 
sions of counselee progress and do not feel that instruments are 
useful or even feasible, and partly because of measurement dif- 
ficulties per se . The measurement difficulties are of two types: 
those having to do with the unreliability of human observers 
(Bruner and Tagiuri, 1954); and those having to do with develop- 
ment of proper scales, once reliable observations are obtainable, 
i.e., the problem of change scores, etc. 

2. The various counseling and therapeutic methods have not 
been operationally defined. As Ford and Urban (1963) have observed 
the proponents of the major systems of psychotherapy have generally 
avoided describing precisely what the therapist does to produce 
change in his clients. Problems of technique are usually discussed 
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in terms of effects to be achieved, such as reduction of anxiety, 
rather than in terms of procedures used to achieve these effects. 
While differences among the various schools of psychotherapy in 
their beliefs about how counseling ought to be conducted can be 
described at an abstract level (Sundland and Barker, 1962; McNair 
and Lorr, 1964), actual differences in procedure usually have to 
be determined after the fact from an analysis of interview pro- 
tocols (Danskin, 1955; Hoffman, 1959; Campbell, 1962; Strupp , 1957). 
As in other areas of human behavior, there is frequently a differ- 
ence between what counselors say and what they do. 

3. The same method of counseling may have different effects 
on different counselees . It seems likely that such pre-counseling 
characteristics of counselees as anxiety, defensiveness, or 
particular kinds of expectations probably influence their behavior 
in the interview and, also, the outcomes of counseling. However, 
this proposition has been only partially supported by research 
(Toler and Kissinger, 1965; Ashby, Ford, Guerney and Guerney, 

1957) . 

4. Different types of counselee problems may require dif- 
ferent counselor techniques ( Pallone and Grande, 1965). Some 
counselors believe that a student who is engaged in educational 
planning, for example, may need a different kind of help than one 
who is heavily involved in interpersonal conflicts which interfere 
with his studies. 

5. The counselor’s personality, i.e., his appearance, manner, 
non-verbal behavior, etc., apart from his training or his method 
may influence the outcomes of counseling (Ashby, Ford, Guerney 
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and Guerney, 1957; Fiedler, 1950, 1951). However, again the 
research findings are neither consistent nor conclusive. 

6. Even when a hoped-for change occurs in a counselee, it 
is difficult to determine what events in the interview or in the 
counselee' s life outside of the interview caused the change. 
Problems relating to research design have been explicated by 
Campbell and Stanley (1963) and by Goldstein, Heller and Sechrest 
(1966). 

In addition to the above categories , there are a number of 
problems which are more or less technological in nature. They 
have to do with developing a workable plan for experimental 
research in a naturalistic setting. There are the obvious tasks 
of selecting or creating instruments, of finding subjects, of 
training personnel to act as counselors and data processors. In 
addition there is the subtle task of developing a way for the 
investigator to "manipulate" the behavior of the counselor with- 
out distorting the interview and making it unrealistic. 

Then there are ethical problems. Not all counselors are 
willing and able to participate in experimental research, for some 
believe that to follow an experimenter's directions rather than 
the counselor's own intuitive judgment is to withhold help from 
some counselees and is, therefore, immoral. Obviously ethical 
as well as research conventions must be satisfied. 

The enterprise to be described in this paper was concerned 
in large part with technological problems, particularly with devel- 
oping a way of controlling an interviewer's behavior and of gath- 
ering data while the interviewer is conducting a "natural" counsel- 
ing interview. It is part of a continuing research project aimed 
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at developing an instructional mode of counseling (Sorenson, 1967), 

While some hypotheses were tested and the results reported below, 
the research findings are not as important at this phase of the 
project as is the general research strategy which has been devel- 
oped. Both the number of subjects and the number of interviews 
were relatively small. The attrition rate was relatively high-- 
high enough to prevent the testing of some of the hypotheses 
which it was planned to test; the outcome measures have to do 
with intermediate rather than long-term counseling goals; and 
there are other limitations which will be evident. In spite of 
these limitations, some of the findings are provocative and 
instructive; and it would appear that the general strategy is 
sufficiently promising to justify description and replication, 
of course with appropriate steps to remedy the obvious defects. 

The Study 

Thirty-six subjects, all women, volunteered to participate j 

in three interviews and an evaluation session. They were informed 
that they were participating in a study of counseling procedures, 
but were given no other information about the project. Each sub- 
ject was randomly assigned to one of three counselors and to one 
of three experimental counseling modes. Data about the subjects 
and about the outcomes of counseling were collected by means of 
standardized questions during the interviews and by self-reports 

a) before each interview and b) a week after completion of counsel- 
ing . 
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The Subjects . Two hundred and fifty elementary- level student 
teachers at UCLA were tested on a measure of stress in student 
teaching and were then informed that a limited number of short 
counseling interviews would be made available. About one-fourth 
of the group indicated an interest in counseling. Thirty-six 
volunteered to participate in the required number of sessions and 
at the required times, and they became the subjects of this study. 
All 36 completed at least one interview. Thirty-one completed two 
interviews. Twenty-one completed three interviews. All 36 sub- 
jects completed the evaluation session. 

During the interviews the students talked about a variety of 
problems which may be roughly categorized as follows: a) Conflict 

with supervising teacher, usually about their beliefs concerning 
the role of teachers, b) Problems of controlling their pupils' 
behavior in the classroom- -"maintaining discipline." c) Lack of 
self-confidence, the feeling that one v/as not doing a good job, 
e.g,, "I can't think of enough things to have my pupils do." 
d) Difficulties in maintaining a heavy and complex work- study- 
commuting schedule, e) Conflict with husband or other members 
of the family. f) Educational and vocational planning, deciding 
whether or not to continue in teaching, kind of work assignment 
preferred, or alternatives to teaching. 

Three items of information about individual differences in 
subjects were collected. On each of these three variables, the 
sample was divided into high and low groups. The variables were 
as follows: 

1. Amount of stress experienced in student teaching. The 
stress measure consisted of 14 statements relating to a) lack of 
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self-confidence in the teaching situation, e.g. , "I am thinking 
about giving up my plans for becoming a teacher"; b) feeling that 
student teaching is an unpleasant experience, e.g., "I wish I 
didn’t have to enter the room for my student teaching"; c) overt 
manifestations of stress, e.g., "I am eating more (or less) than 
usual . " 

2. Preference for type of counseling. The Counseling 
Preference Questionnaire (CPQ) consists of 13 pairs of statements 
designed to get at a subject's preferences or expectations regard- 
ing counseling, the poles being designated "general- internal" in 
emphasis, as contrasted with a counseling approach that is "spe- 
cific-external" in emphasis. 

Examples : 

la. I would like someone to help me with some specific 
problems that are currently troubling me. 

lb. I would like to engage in self -exploration . 

8a. I would like a counselor who would try to accept 
me as I really am. 

8b. I would like a counselor who is able to teach me 
something useful. 

The subjects were directed to choose one statement from each 

pair . 

3. Academic ability. The student's overall grade point av- 
erage (GPA) was taken as an index of academic ability. 

The criterion variables . Counselors usually try to change 
either the interviewee's overt behavior or his feelings about him- 
self and the world. We were trying to produce both kinds of 
change. The goal of all three experimental modes was to have the 
counselee leave the interview with a plan- -to try out some mental 
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or physical action in regard to his problem or concern, and to 
achieve a more comfortable feeling about himself and his world. 
However, these goals were not stated explicitly by the counselors 
in any of the interviews. The criterion measures were the follow- 
ing : 

1. Alternatives tried between interviews (ATBI) . Counselees 
were asked to report at the beginning of the second and third 
interviews any actions which they had taken to try out plans made 
during previous interviews or as a consequence of previous inter- 
views. "Since our last session, have you done anything differently, 
or had any new feelings or thoughts about what was bothering you 
last week.?" When all of the interviews were completed, the coun- 
selees ’ responses to this question were transcribed from the tape 

to 8" x 5" cards, one card per interview. A judge, or rater, 
then read each response card and decided how many activities the 
subject had reported. 

2, Mood Check List. Five of the seven mood factors isolated 

by McNair and Lorr (1963) were used as criterion measures: Tension- 

Anxiety, Anger-Hostility, Depression-Dejection, Vigor-Activity, 

and Friendliness. A check list was constructed by selecting the 
five adjectives with the highest factor loadings to represent each 
of the five factors. The adjectives were then listed on a single 
page in such a way that every fifth adjective represented the same 
factor. The counselee was instructed to rate each adjective on a 
four-point intensity scale. Intensity modifiers were "not at all," 
"a little bit," "quite a bit," "extremely." For scoring purposes 
the modifiers were assigned weights of 1, 2, 3, and 4. The Mood 
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Check List was administered before each interview and at the 
beginning of the evaluation session. 

3. Counseling Evaluation Form (CEF) . This form consisted 
of 47 items. Six items asked the counselee to rate the degree to 
which his feelings and attitudes about himself had changed during 
the two- or three-week period of counseling. Six items asked him 
to report the degree of satisfaction and comfort he had experi- 
enced with the interviews. Twenty-nine items asked whether he had 
learned anything about a variety of topics . 

4. Attrition rate. One indication of whether a counselee 
feels he is getting something worthwhile from counseling is whether 
or not he keeps his appointments and continues in counseling. For 
this reason the "drop-out" rate has been of interest to a number 

of counselors and psychotherapists. In the present study some of 
the differences between those who continued and those who completed 
fewer than three interviews were examined. 

The treatment variables ,, We did not try to represent any 
established method of counseling such as psychoanalytical or 
Rogerian in this study. Instead, the assumption was that any 
method of counseling can be regarded as consisting of a) a number 
of descnbable components, or categories of counselor behavior, 
some verbal and some non-verbal; and b) a set of rules or direc- 
tions about when to use each component, when to shift from one to 
another, and which categories to avoid using. Porter (1950) made 
a start m this direction, among others. (We do not assume that 
counselors are always aware of, let alone able to describe in 
words, the categories or behavior they employ or the heuristics 
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that determine their choice. It seems likely that for most coun- 
selors these categories are intuitive and habitual and not entirely 
deliberate. However, we do assume that the categories or behavior 
patterns can be observed and the rules inferred by a skillful 
observer . ) 

Mode 1. In mode 1, "Inquiry,” it is intended that the coun- 
selor be a special kind of teacher, one who tries to teach skills 
that will enable the counselee to solve not only the problems which 
brought him to the interview, but also similar kinds of problems 
on future occasions (Sorenson, 1967) . 

Mode 2. In mode 2, "Advisory," the counselor assumes the 
role of an experienced and presumably wise person who analyses the 
counselee ’s problems, provides the counselee with some perspective, 
and also suggests some things he might do. 

Mode 3. In mode 3, "Affective," the counselor acts mainly as 
a listener who encourages the counselee to explore his own feel- 
ings. The hypothesis here is that the counselee’s strong feelings 
block action by producing confusion and ambivalence about goals, 
and that when these feeling are adequately verbalized and recog- 
nized by the counselee, the confusion and ambivalence will be 
dispelled. The counselee will then either feel differently, i.e., 
no longer be troubled, or he will be free to act and to invent 
solutions to his problems. 

The three modes are outlined in Table 1. 

Three steps were taken before the interviews were conducted 
to make certain that each research counselor would practice the 
appropriate mode in each of his interviews : 



Three Experimental Modes of Counseling Categories of Counselor Verbal Behavior 
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1. Each counselor was provided with three interview schedules, 
one for each mode, to be used as a guide to his behavior during the 
training sessions and during the actual interviews. (As it turned 
out, the counselors did not use the interview schedules after the 
first few interviews, having by that time memorized them.) The 
interview schedule provided for each mode specified which verbal 
categories were to be used and when, and which verbal categories 
were not to be used. Illustrations were included. 

2. The research counselors, together with the investigators, 
participated in discussions of the goals of the research, the use 
of the modes, problems likely to be encountered, ways of keeping 
the three modes independent. 

3. The three counselors role-played the different modes. 

They, together with the investigators, observed one another's 

enactment of each role and provided corrections and suggestions to 
one another. 

Two coders who were unaware of the experimental design were 
trained to do a content analysis of the counselors' verbal behav- 
ior, working from tape recordings. All of the second interviews, 
except for two which were inaudible, were analyzed by one or the 
other of the two coders. Five cases were analyzed by both coders 
working independently of one another. Each of the counselors' 
statements was assigned a sequential number and one of 14 category 
numbers. The categories were as follows: 

1. Preliminary iriendly talk, e.g., weather, lateness. 

2. Structuring comments, e.g., any explanation of the 
process or purpose of counseling. 
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3. Searching for a topic, e.g., statements which aim at 
identifying a topic for discussion, a concern, or a 
problem , 

4. Questions about what the counselee had done or thought 
about since the last interview, e.g., how have things 
gone... have you done anything dif f erent . . . f elt different? 

5. Questions which ask for general information about past 
or external events, e.g., asking the counselee to elab- 
orate on details of his problems or the reasons for his 
ideas or actions. 

6. Questions which ask the counselee to think about his own 
problem in terms of clarifying his goals and obstacles, 
generating alternatives, examining probable consequences 
of alternatives, or choosing a plan of action. 

7. Questions which ask the counselee to talk about himself 
or his feelings, e.g., asking the counselee to look at 
himself and his feelings about his actions, the actions 
of others, his feelings about counseling and the coun- 
selor . 

8. Summaries, restatements, and reflections, e.g., repeti- 
tion of anything the counselee has said, anticipation 
of what the counselee is about to say, making explicit 
what is implied by what the counselee has said. 

9. Contentless interjections and other brief statements which 
do not introduce any content and leave the counselee to 
control the topic, e.g., mmhm, yeah, sure. I see, really, 
yes, uhuh. 

10. Statements about the counselor’s here and now feelings 
about something happening in the interview. 

11. Suggestions, advice, prescribed action, persuasion or 
urgings . 

12. Information giving a) teaching a concept or providing 
relevant factual information for the counselee ’s use. 

13. Information giving b) explanation, interpretation, talk 
about the counselor’s philosophy, values, or experiences, 
presented with authority and in the expectation that the 
counselee should accept it as valid and relevant, 

14. Other. Less than 1 percent of the responses fell into 
this category. 

Categories 1, 2, 3, 4, 9 and 14 were used in all modes and 
are designated ’’Common" categories. 
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The categories which follow are designated "Defining" 
categories : 

Categories 6, 8, and 12 define mode one. 

Categories 5, 11, and 13 define mode two. 

Categories 7, 8, and 10 define mode three. 

Unfortunately we were not able to differentiate between 
mode 3 "restatements" and mode 3 "reflections"; and so while 
category 8 differentiates mode 2 from modes 1 and 3, it does not 
differentiate between modes 1 and 3. 

Inter-coder consistency was checked by having the coders 
code the tape recordings of five interviews independently and 
then comparing their work. Overall, they agreed on 83 percent of 
the counselor responses. Category 12, "teaching of principles," 
was the most difficult to code, showing agreement only about 70 
percent of the time. Category 9, "contentless interjections," 
was easiest to code; there was agreement on about 90 percent of 
these responses. 

The complete set of second interviews for all counselors 
was categorized on separate coding sheets for each interview. 

For each of 29 interviews , an estimate of error was obtained by 
examining the proportion of statements in each mode which were 
defining for one of the other two modes, i.e., the proportion 
of verbal statements that should not have been present in each 
mode. This information is presented in Table 2 and in Table 3, 
which is a condensation of Table 2. 

It will be noted from Table 3 that the least amount of error, 
9 percent, occurred in mode 3, while the largest amount of error, 
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Based on all counselors 1 responses in the second interview for all counselors . 
in Mode I, n = 9 in Mode II. n= 13 in Mode III. 



Table 3 



Summary of Acceptable and Error Counselor Verbal Responses 





MODE I 




MODE II 




MODE III 






Cate- 

gories 


£ 


Cate- 

gories 


1 


Cate- 

gories 


% 


Acceptable 

Verbal 

Responses 

Defining 

Categories 


6,8,12 


43.6 


5,11,13 


34.0 


7,8,10 


33.5 


Common 

Categories 


1-4,9 


44.2 

$7.¥ 


1-4,9 


40.5 

7475 


1-4,9 


57.5 

91.0 


Error 

Responses 


5,7,10 

11,13,14 


12.2 


6,7,8 

10,12,14 


25.5 


5,6,11 

12,13,14 


9.0 



25.5 percent, occurred in mode 2. An examination of Table 2 will 
show that most of the error in mode 2 was in the "restatement-re- 
f lective" category. In other words, the counselors were more re- 
flective in mode 2 than was intended. 

The error in mode 2 was not regarded as so great as to 
invalidate the other results of the study. [Pallone and Grande 
(1965) had used a criterion of 70 percent acceptable responses 
for all interviews] However, because mode 2 was more similar to 
the other two modes than was intended, some of the results may 
have been "flattened” because of a reduction in the experimen- 
tally produced variance. 

The second set of data about manipulation of the independent 
variable consists of the counselor’s responses to five items of 
the Counselor Information Sheet. These items were: 

8. I felt that overall this session was helpful to the 
counselee . 

9. I was able to stay pretty consistently within the 
specified mode of counseling. 

10. I was effective in meeting the objectives of the 
specified mode . 

11. This counseling was useful with this counselee. 

12. Another counseling mode would have been more helpful 
with this counselee. 

Table 4 summarizes the frequency and proportion of the 
counselors' combined responses to each of the above five items 
grouped by counseling modes. The 83 interviews contributing to 
the data are distributed as follows: mode 1, 22; mode 2, 26; 

mode 3, 35. Table 5 reports chi-square analyses of the obtained 
frequencies . 
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Table 4 

Summary of Obtained Frequencies and Proportions 
for Counselor Post- Interview Responses on CIS 
Item for 83 Interviews 9, 

Item 8: I felt that overall, this session was helpful to the counselee. 







MODE I 


MODE 


II 


MODE 


III 


TOTALS 


Mr 


f 




f 




f 


% 


f 


1 


AGREE 


13 


68.5 


7 


37 


16 


69. S 


36 


59 


DISAGREE 


6 


31.5 


12 


63 


7 


30.5 


25 


41 


TOTALS 1 * 


19 




19 




23 




61 




Item 9: 


I was able to stay consistently with the specific mode 
counseling. 


of 






MODE I 


MODE 


II 


MODE 


III 


TOTALS 




f 




f 


% 


f 


£ 


f 


% 


AGREE 


18 


94.7 


18 


85.9 


28 


93.3 


64 


91.4 


DISAGREE 


1 


5.3 


3 


14.1 


2 


6.7 


6 


8.6 


TOTALS 


19 




21 




30 




70 





Item 10: I was effective in meeting the objectives of this mode. 









MODE I 


MODE 


II 


MODE 


III 


TOTALS 




f 


% 


f 




f 




f 


% 


AGREE 


12 


60 


17 


81 


22 


84.6 


51 


76.2 


DISAGREE 


8 


40 


4 


19 


4 


15.4 


16 


23.8 


TOTALS 


20 




21 




26 




67 
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Table 4 (continued) 

Item 11: This counseling mode was useful with this counselee 





MODE I 




MODE II 


MODE 


III 


TOTALS 




f 


% 


f 


% 


f 


% 


f 


% 


AGREE 


12 


70.6 


10 


66.7 


15 


68.2 


37 


68.5 


DISAGREE 


5 


29.4 


5 


33.3 


7 


31.8 


17 


31.5 


TOTALS 


17 




15 




22 




54 





Item 12: 


Another mode would have been more 


helpful with this counselee 




MODE I 




MODE II 


MODE 


III 


TOTALS 




f 


% 


f 


% 


f 


2 


f 


% 


AGREE 


3 


15.8 


6 


42.8 


12 


57.2 


21 


38.8 


DISAGREE 


16 


84.2 


8 


57.2 


9 


42.8 


33 


61.2 


TOTALS 


19 


♦ 


14 




21 




54 


- 



a There were 22 CIS forms completed for Mode I interviews, 26 for Mode 
II and 35 for Mode III. 

^Neutral responses were omitted for sake of clarity and precision. 
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Table 5 

Chi-square Analyses of Counselor Post -interview 

3 . 

Responses on CIS Items for 33 Interviews 
Item 8: I felt that overall, that session was helpful to the counselee. 





MODE 


I 


MODE 


11 


MODE 


III 


TOTALS 




0 


E 


0 


E 


0 


E 




AGREE 


13 


11.2 


7 


11.2 


16 


13.6 


36 


DISAGREE 


6 


7.8 


12 


7.8 


7 


9.4 


25 


TOTALS** 


19 




19 




23 




61 


Item 9: 


I was able 
counseling. 


to stay consistently with the specific mode of 






MODE 


I 


MODE 


II 


MODE 


III 


TOTALS 




0 


E 


0 


E 


0 


E 




AGREE 


18 


17.4 


18 


19.2 


28 


27.4 


64 


DISAGREE 


1 


1.6 


3 


1.8 


2 


2.6 


6 


TOTALS 


19 




21 




30 




70 



Item 10: I was effective in meeting the objectives of this mode. 







MODE I 


MODE 


II 


MODE 


III 


TOTALS 




0 E 


0 


E 


0 


E 




AGREE 


12 15.2 


17 


16 


22 


19.8 


51 


DISAGREE 


8 4.8 


4 


5 


4 


6.2 


16 



X 

P 



X 



X 




=5.56 

0.06 



=1.28 

n.s 



=4.09 

n.s. 



TOTALS 



20 



21 



26 



67 
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Table 5 (continued) 

Item 11: This counseling mode was useful with this 

counselee. 





MODE 


I 


MODE 


II 


MODE 


III 


TOTALS 




0 


E 


0 


E 


0 


E 




AGREE 


12 


11.6 


10 


10.3 


15 


15.1 


37 X 2 =0.07 


DISAGREE 


5 


5.4 


5 


4.7 


7 


6.9 


17 n.s. 


TOTALS 


17 




15 




22 




54 





Item 12: 


Another counseling mode would have been more 
useful with this counselee. 






















MODE 


I 


MODE II 


MODE 


III 


TOTALS 






0 


E 


0 E 


0 


E 




X 2 =7.28 


AGREE 


3 


7.4 


6 5.4 


12 


8.2 


21 


P 0.05 


DISAGREE 


16 


11.6 


8 8.6 


9 


12.8 


33 




TOTALS 


19 




14 


21 




54 





^here were 22 CIS forms completed for Mode I interviews, 26 for 
Mode II, and 35 for Mode III. 

^Neutral responses were omitted here for sake of clarity and 
precision. 
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The counselors' responses to the Counselor Information Sheet 
indicate that they saw themselves as staying within the boundaries 
of the specified modes 91 percent of the time (item 9) . They 
felt that they had met the objectives of the specified mode over 
80 percent of the time in modes 2 and 3, but only 60 percent of 
the time in mode 1. In this sense, they found mode 1 the most 
difficult to follow. The counselors saw modes 1 and 3 as helpful 
about 70 percent of the time, but mode 2 as helpful only 37 per- 
cent of the time. Their response to item 12 indicates that they 
were inclined to regard mode 1 as generally the most helpful and 
mode 3 as generally the least so. 

The third set of data regarding the independent variables is 
provided by the counselees' responses to those items of the CEF 
which describe their perception of the counselor's personal qual- 
ities. Those who criticize research in which counselors are asked 
to use alternative modes of counseling or to vary their personal 
styles for research purposes sometimes argue that important per- 
sonal characteristics of the coui selor will inevitably prove more 
effective in one mode than in another. If that argument is sound, 
then in projects such as the present one, there should be signif- 
icant counselor x mode interaction. The data in Table 6 would 
suggest that if there was interaction between counselor and mode, 
it did not influence the way the three counselors were perceived 
in any of the three modes. In all three modes the counselors 
were perceived as warm, sincere, likable and friendly. 
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Table 6 



Analysis of Variance for Counselor x Mode Effects 
on ’’Perception of Counselor’s Personal Qualities” 



Source of Variation 


df 


ss 


ms 


F Ratio 


P 


Counselor 


2 


15.24 


7.62 


0.29 


n.s. 


Mode 


m 

L 


29.59 


14.79 


0.56 


n.s. 


C X M 


4 


116.70 


29.18 


1.11 


n.s. 


Error 


24 


613.92 


26.33 
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The Hypotheses 

While the attempt to test hypotheses was not outstandingly 
successful, it would seem useful to present our results for two 
reasons: One, some of the findings, both positive and negative, 

suggest useful hypotheses for testing in future research. Two, 
the inconclusive results have implications for the kinds of im- 
provements in technology, e.g., in instrumentation, that are 
needed for future research. There will be additional comment on 
these two points in the discussion section. 

Hypothesis 1. In mode 1, "inquiry," counselees will try a 
larger number of alternative courses of action between interviews 
toward solving their own problems than will counselees jn the other 
two modes. This prediction was based on the assumption that en- 
couragement to practice inventing and trying alternatives will be 
more effective than either telling counselees what to do or trying 
to "free them" emotionally. Furthermore, learning to solve prob- 
lems has important, concomitant motivating and reinforcing effects. 
A greater amount and wider range of action should result if one 
decides to work towards his own solutions by generating and test- 
ing alternatives than if one is merely told which alternative to 
try . 

It was not possible properly to test this hypothesis in the 
present study. The plan was to use the "Alternatives Tried Between 
Interviews" (ATBI) data reported by the counselees at the begin- 
ning of the second and third interviews as coded by the two judges. 
Table 7 , which shows ATBI scores according to mode and interview 
number, indicated a trend in the predicted direction. But in only 
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Table 7 



Summary o£ Scores for Alternatives Tried between 
Interviews by Counseling Modes 



SECOND INTERVIEW THIRD INTERVIEW 







n 


ATBI a 


MEAN 

ATBI 


n 


ATBI a 


MEAN 

ATBI 


MODE 


I 


7 


6.5 


.93 


5 


8 


1.60 


MODE 


II 


10 


4.5 


.45 


5 


3.5 


.70 


MODE 


III 


13 


11.5 


.89 


9 


1.5 


.17 






30 


22.5 




19 


13 
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52 percent of the interviews did the ccunselee report that he had 
tried any of the plans discussed m previous interviews. Moreover, 
although the proportion of dropouts was not appreciably different 
for the three modes, sizable attrition occurred with successive 
interviews. The data are therefore unfortunately not amenable to 
conventional statistical tests, the number of cases in some cells 
being too few to make chi square appropriate and the skewed dis- 
tribution making the use of parametric tests questionable. 

The mean ATBI score reported at the second interview by 
counselees in mode 1 was slightly higher than the average score 
for mode 3 counselees, and twice as large as for mode 2 counselees. 
By the third interview, the discrepancy between mode 1 and the 
other two modes increased further Considering the small N, the 
trend of the data suggest that the hypothesis should be given 
further attention in the next phase of the project. 

Hypotheses 2, In mode 1, high - achieving counselees will try 
more alternatives between interviews than low- achieving counselees. 
This prediction is based on the more general hypothesis that self- 
concept, and particularly the degree of self-confidence, is an 
important determinant of behavior. It seemed plausible that high 
achievers, because they have experienced greater academic success 
and therefore would be more self-confident, would be likely to 
find the business of generating and evaluating alternatives an 
easier task than low achievers and would be likely to test ideas 
more freely. Low achievers would be likely to see fewer alterna- 
tive courses of action and be less inclined to try them. 
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This hypothesis could not be tested. Only one low-achieving 
counselee contributed to the ATBI data for mode 1. The ATBI score 
•for this counselee was higher than the average score for the high 
~r\A group (see Table 8) , but this single score does not provide 
an adequate basis for testing the hypothesis. 

Hypothesis 3. In mode 2, "Advisory," low-achieving coun- 
selees will try more alternatives between interviews than high- 
achieving counselees . The reasoning here was that perhaps low- 
achieving student teachers who are motivated to come for coun- 
seling would be more willing than high achievers to take direc- 
tion, to "do as they are told," and less likely to reject the 
counselor’s advice because they would in some way feel less sure 
and more dependent. 

This hypothesis was supported, though of course the posi- 
tive results do not indicate that the reasoning back of it was 
correct. Table 8a shows the ATBI scores for high and low GPA 
counselees in each mode. Inspection of the data for mode 2 
suggests that the typical score for low GPA counselees was 
greater than for high GPA counselees, A t^ test, (Table 8b) f 
indicates the difference is statistically significant. 

Observing that the ATBI data show consistently higher 
mean scores for the low GPA counselees, we thought that we 
might gain additional information about this effect by exam- 
ining the counselees’ taped reports of multiple alternatives 
tried. Our ex post facto hypothesis was that perhaps high 
GPA counselees were in some sense more efficient and needed 
to try fewer courses of action to work out their problems. 




Table 8a 



Summary of ATBI Scores by Mode and GPA Level 
(Averages of Second § Third Interview Scores) 







HIGH GPA 
n ATBI 


MEAN 

ATBI 


n 


LOW GPA 
ATBI 


MEAN 

ATBI 


MODE 


I 


6 


3.5 


.58 


1 


4.5 


4.50 


MODE 


II 


5 


1 


.20 


5 


4.5 


.90 


MODE 


III 


5 


1.5 


.30 


8 


6.75 


.84 






16 


6.0 


.375 


14 


15.75 


1.12 



Table 8b 

Comparison of ATBI Scores for High- and Low-GPA 
Counselees in Mode II 



N 



Mean ATBI c n S-E.^.^c . 

S.D. diff. t 

Score 



P 



High- GPA 
Counselees 



0.20 



0.45 



0.14 



5.0 



Low-GPA 

Counselees 



0.90 0.88 



0.01 



Table 8c 

Number of Counselees Reporting 0, 1 and more 
than 1 ATBI for High- and Low-GPA Level 







HIGH-GPA 


LOW-GPA 


ATBI » 0 


8 


3 


0 < ATBI < 1 


6 


5 


ATBI > 1 


2 


6 
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Table 8c shows the ATBI data organized by GPA level and by the 
number of counselees reporting zero, one, or more than one alter- 
natives tried. Inspection shows that not only did fewer low GPA 
counselees report trying no alternatives, but also that the low 
GPA counselees tended more than the high to try more than one course 
of action. 

Hypothesis 4. High-stress counselees will have a lower 
attrition rate than low-stress counselees. Counselees who report 
a higher level of personal stress will be more motivated to attend 
counseling, regardless of the mode or its effectiveness and will 
be less likely to drop out before the three interviews have been 
completed . 

This hypothesis was supported. Five counselees dropped out 
after one interview, and ten more after the second, the N for the 
first interview being 36, for the second 31, and for the third, 

21. The mean number of interviews for the total sample was 2.45, 
Table 9a shows that the mean stress score on the Reaction to Stu- 
dent Teaching scale was somewhat higher for the sample (p less 
than .06) than for the population of 250 from which it was drawn, 
even though a third of those who came for counseling had stress 
scores below the mean for the non-counseled group. When the num- 
ber of interviews attended by the 18 high and the 18 low-stress 
counselees is compared (see Table lib) , the difference in number 
of interviews attended by the two groups is in the predicted 
direction and is significant at the .005 probability level. 

Hypothesis 5. Counselees in modes 1 and 2 will show greater 
positive changes than will counselees in mode 3 on a) the mood 



Table 9a 



Mean Stress Scores for Counseled and Non- 
Counseled Student Teachers 





,Mean Stress c n 
N Score b * D * 


S - E - diff. 


t 


p* 


Counseled 
Student Teachers 


36 


22.95 4.66 


0.87 


1.86 


0.06 


Non-Counseled 
Student Teachers 


191 


21.33 4.88 








*P is based on 


a two-tailed test. 












Table 9b 









Comparison of Interviews Attended for High- and 
Low-Stress Counselees 





N 


Inter- 

views 

At- 

tended 


MEAN 


S.D. 


S.E. , . rr 
diff . 


t 


psfe 


High Stress 
(> 23) 
Counselees 


18 


49 


2.72 


0.460 


0.229 


2.62 


0.005 


Low Stress 
(< 23) 
Counselees 


18 


39 


2.17 


0.857 










36 


88 












*P is 


based on 


a one-tailed 


test. 
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scales, b) the f eelings-about -self measures and c) the attitude- 
toward-external-environment measure . 

Modes 1 and 2 focus primarily on the individual ' in relation 
to his external world. White (1962) has described a relationship 
between psychological well-being and involvement in activities 
which are designed not to make him more ’’self-aware,” but in 
activities in which he can learn to manipulate his environment 
more effectively. If this latter type of activity is engaged in, 
and if it does lead to a sense of autonomy and self-determination, 
then one ; s attitudes about himself and his external world ought 
to be positively influenced, as should his general moods. 

This hypothesis was not supported. 

1. Mood factors. Table 10 indicates that analysis of av- 
erage change scores in the five mood factors shows no differences 
that can be attributed to the experimental variables. Only one 

F ratio approaches statistical significance and that one, which 
suggests an interaction of mode with GPA on the friendliness factor, 
will be difficult to interpret if it reappears on subsequent 
studies . 

2. Feelings about self. The rank order of means . in the 
predicted direction but the differences are not statistically 
significant (Tables 11a and lib) . 

3. Attitude about the external environment. The means 
order in the predicted direction, but the differences are nci stat- 
istically significant (Tables 12a and 12b) . 

Hypothesis 6. Counselees will be more satisfied with mode 2 
counseling and least satisfied with mode 3. 




Table 10 

Summary of Analyses of Variance on Five Mood Factors (Based on Average 
Change Scores for 2, 3 or 4 Administrations) 
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Table 11a 



Means and Standard Deviations of Scores for 
Modes on "Feelings About Self" Scale 
(High Score means high change) 



RANK 


MODE 


MEAN 


S.D. 


N 




1 


I 


16.63 


1.302 


8 




2 


II 


16.40 


2.011 


10 




3 


III 


14.92 


4.033 


12 





Table lib 

Analysis of Variance for Modes on "Feelings 
about Self" Scale 



Source 


Sum of 
Squares 


D.F. 


Square F " Ratl ° P 


Between Modes 


18.28 


2 


9,14 1.09 n.s. 


Within Modes 


227.19 


27 


8.41 



Table 12a 



Means and Standard Deviations of Scores for 
Modes on ’’Attitudes about External 
Environment” Scale (High Score 
means greater change) 



RANK 


MODE 


MEAN 


S.D. 


N 


1 


I 


21.13 


2.17 


8 


2 


II 


21.00 


2.00 


10 


3 


III 


20.17 


2.13 


12 



Table 12b 

/dialysis of Variance for Modes on ’’Attitudes 
about External Environment” Scale 



Source 



Sum of 
Squares 



Mean 

Square 



F -Ratio 



P 



Between Modes 5.76 



2 2.88 



0.66 



n.s. 



Within Modes 



118.54 



27 



4.39 
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The sample of subjects comes from a population of college 
students who, it is postulated, have become relatively comfortable 
in a learning situation involving authority and dependency rela- 
tionships, and, as a consequence, they are more likely to feel 
comfortable in a situation in which the counselor gives them a 
good deal of direction, tells them what to do. Both modes 1 and 
3 try to guide the counselee in one way or another to help him- 
self. Mode 2 does not require the counselee to take very much 
responsibility for what happens in the interview. Mode 3 might 
be expected to be least satisfactory because it not only requires 
the counselee to analyze his own situation while avoiding giving 
suggestions, but also requires him to focus on his internal world. 

The hypothesis was supported. The satisfaction scores, 
grouped by mode in Table 13a, indicate a trend in the predicted 
direction, and the t. test shown in Table 13b is significant at 
the .05 probability level. 

Hypothesis 7. In mode 3, counselees with a preference for 
a "general-internal" type of counseling will be more satisfied 
than counselees with more "specific-external" preferences. 

It seems plausible to expect that counselees who come for 
counseling about a tangible problem in their relations with events 
outside themselves will be less comfortable in a mode of counsel- 
ing which focuses on their internal world than those who prefer 
counseling to be more general and to deal with their feelings. 

The hypothesis was not supported. Table 14a lists the means 
and standard deviations of the six mode x preference sub-groups. 
The F ratios in Table 14b indicate that there is no interaction 
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Table 13a 



Means and Standard Deviations of Scores for 
Modes on ’’Satisfaction with Content and 
Process of Interviews” (Low score means 
high-satisfaction) 



RANK 


MODE 


MEAN 


S.D. 


N 


1 


II 


11.30 


3.27 


10 


2 


I 


13.10 


3.72 


10 


3 


III 


14.50 


5.11 


13 



Table 13b 

Summary of t-test for Mean Satisfaction Scores 
between Mode II and Mode III Counselees 



^Mode III “ ^Mode II 




3.24 


S.E. difference 


1.86 


t statistic 


1.74 



one-tailed p 



0.05 



Table 14a 



Means and Standard Deviations of Mode X Preference 
Sub-groups on "Satisfaction with Content and 
Process of Counseling". Scale (Low 
store means high satisfaction) 



RANK 


MODE X PREFERENCE 


MEAN 


S.D. 


N 




1 


II 


Low 


10.60 


4.56 


5 




2 


II 


High 


12.00 


1.41 


5 




3 


I 


Low 


13.00 


4.64 


5 




4 


I 


High 


13.20 


3.11 


5 




5 


III 


High 


13.75 


4.86 


8 




6 


III 


Low 


15.80 


5.81 


5 





Table 14b 

Analysis of Variance for Mode X Preference on 
"Satisfaction with Content and Process 
of Interviews" 



SOURCE 


SUM OF 
SQUARES 


D.F. 


MEAN 

SQUARE 


F-RATIO 


P 


MODE 


66.72 


2 


33.36 


1.74 


0.20 


PREFERENCE 


0.18 


1 


0.18 


0.01 


n.s. 


MODE X PREF. 


17.27 


2 


8.64 


0.45 


n.s. 


ERROR 


516.30 


27 


19.12 




n.s. 
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between counseling mode and preference group. A t test specific 
to the question about preference effects among mode 3 counselees 
showed no significant differences (Table 14c) . 

Hypothesis 8. In mode 1, high-achieving counselees will be 
more satisfied with the content and process of counseling than low- 
achieving counselees. 

It has been observed that the kinds of cognitive tasks ex- 
pected of counselees in mode 1 can be difficult for persons who 
do not have either some concepts about how to approach problems 
in an orderly way in order to solve them, or the motivation to 
come to grips with their problems and to take self -directed action. 
Thus, if GPA represents some function of the counselee’s ability 
to analyze practical problems and take action, then high achievers 
should be more comfortable with mode 1 than those who presumably 
have less well-developed analytical skills or who are less moti- 
vated to take action about their concerns. 

This hypothesis was supported. Table 15a displays the means 
of the six modes x GPA sub-groups. The greatest discrepancy is 
between mode 1 high GPA counselees and mode 1 low GPA counselees. 
The most satisfied sub-group was the mode 1 high GPA counselees. 

The least satisfied was the group of mode 1 low GPA counselees. 

The F ratio reported in Table 17b for mode x GPA interaction 
is significant at the .04 level. 

Discussion 

The criterion variables . 1. It would appear that some of 
the measurement problems in counseling research can be partially 
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Table 14c 



Summary of t-test for Preference Effect in 

Mode III 





X Low Pre£. ' %i g h Prs£. 


2.05 


S.E. difference 


2,98 


t-statistic 


0.69 


Probability 


n.s. 
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Table 15a 

Means and Standard Deviations of Mode X GPA Sub- 
groups on "Satisfaction with Content and 
Process of Counseling" (Low score means 
high satisfaction) 





RANK 


MODE X GPA 


MEAN 


S.D. 


N 


1 


I 


High 


10.66 


2.07 


6 


2 


II 


Low 


11.25 


1.64 


4 


3 


II 


High 


11.33 


2.07 


6 


4 


III 


Low 


13.00 


4.02 


7 


5 


III 


High 


16.33 


4.89 


6 


6 


I 


Low 


16.75 


4.65 


4 



Table 15b 



Analysis of Variance for Mode X GPA on "Satis- 
faction with Content and Process of Interviews" 



Sr ’RCE 


SUM OF 
SQUARES 


D.F. 


MEAN 

SQUARE 


F -RATIO 


P 


MODE 


65.66 


2 


32.83 


2.17 


0.14 


GPA 


9.97 


1 


9.97 


0.66 


n.s. 


MODE X GPA 


122.12 


2 


61.06 


4.04 


0.04 


ERROR 


408.62 


27 


15.13 


















mm mm 



mam 
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solved by using self-report devices, questionnaires which ask the 
counselee to report aspects of his own experience, provided care 
is taken to secure the cooperation of the counselee. For example, 
the ’’stress in student teaching" scale shows promise in that a 
relationship was demonstrated between a subject’s responses and 
his tendency to continue in counseling. On the other hand, an- 
other self-report device, the "Counseling Preference Questionnaire" 
was not predictive. In retrospect, it would appear that this 
latter instrument failed to perform as hoped, for perhaps two 
reasons: a) counselees may not know what kind of counseling they 

would prefer--at least not before they have had considerable ex- 
perience with counseling, both with a variety of methods and a 
variety of personalities; b) the language used in the CPQ is 
probably too abstract. Terms which counselors use, such as "accept 
me as I am," constitute a kind of professional jargon. This jargon 
may have some exact meaning to counselors, (although that proposi- 
tion has not been demonstrated), but it is probably not meaning- 
ful to counselees. 

2. Counselee progress, or improvement, or gains may be 
defined in a number of ways, and these may be unrelated to one 
another, or perhaps inversely related. For example, counselees 
who as a result of counseling experience a change of feeling- -a 
reduction in the discomfort which brought them to counseling in 
the first place--may be unlikely to change their overt behavior 
patterns outside of the interview. Other counselees with per- 
haps a different kind of problem may not experience a reduction 
in discomfort from merely talking with the counselor, but may 
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need to change their behavior patterns - -their habitual ways of 
coping with a recurring pattern of events- -in order to change the 
circumstances which produce their discomfort. 

3. Counselor and counselee may evaluate an interview or a 
series of interviews quite differently. An interview seen as 
helpful by the counselee may not be so regarded by the counselor, 
and vice versa . The counselors and counselees in this study 
sometimes differed rather sharply about which counseling modes 
were most helpful to the counselee. However, that is not to say 
that the customer is always right. Especially in school coun- 
seling, the counselor may have ethical and rational goals which 
are not endorsed, at least in the beginning, by the counselee- - 
goals which are in fact inconsistent with the student's goals. 

For example, a counselor may feel justified in trying to change 
the behavior of a bright student whose study habits are poor, or 
a young teen age girl whose sexual behavior threatens to result 
in her pregnancy. The questions of the goals and the ethics of 
counseling need considerably more discussion. 

The treatment variables . 1. Our experience indicates that 
it is possible to control the behavior of the research counselor 
by means of the kind of interview schedule described above, com- 
bined with a moderate amount of training. It seems clear that 
despite overlaps, the research modes were in fact different in 
important ways, and that with revision of the schedules and more 
careful training these differences can be sharpened. What is 
needed for each research mode is an interview schedule that will 
explicate a greater variety of alternative verbal responses for 
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use by the counselor together with clearer rules about when each 
category is to be used. Our experience in this phase of the 
project leaves us hopeful that it is feasible to make such improve- 
ments . 

2. It is probably true that not every counselor can learn 
to function effectively as a research counselor. Selection a^ 
well as training is important. The research counselor mu e t be 
a person who is able to think of himself as an investigator as 
well as a counselor. It would appear that a person well trained 
in a particular mode of counseling is unlikely to be able to ex- 
ercise cognitive control over his own responses in the interview 
because the force of established habits--or established beliefs-- 
is so great. The bright inexperienced person who is willing to 
follow directions is likely to make a much better research coun- 
selor than is the old hand. 

The mediating variables . 1. The research counselors in the 
study saw themselves as preferring one particular mode, but they 
also fe^t that on a number of occasions some other counseling mode 
than the one they were scheduled to use, even if that one were 
their preferred mode, would have been more helpful to the coun- 
selee. While the basis for these judgments is not entirely clear, 
we have some leads. Some counselees, for instance, seemed in- 
clined to reject mode 1 because they felt that nothing could be 
done about their problems. Or, they felt that it was not their 
personal responsibility to cope with the troublesome events, that it 
was really someone elses responsibility to change things. Another 
example, some of the students in mode 3 did not find discussing 
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their problems useful or satisfying and were either unwilling or 
unable to continue in this mode because they wanted to talk about 
some kind of action rather than about feelings. 

2. It may be that in a further phase of this project it 
would be useful to try to develop the first interview as a kind 
of appraisal interview in which the counselor would try to make 
some estimate of the counselee’s degree of self-confidence, his 
willingness to try to define his own goals and actively to cope 
with the obstacles to those goals. It may be that some counselees 
are so lacking in self-confidence and in the sense of potency that 
the counselor will have to spend time, perhaps somewhat in the 
manner of mode 3, to explore their world, including their self- 
concept, and to try to improve that concept. Other counselees, 
higher on an imaginary ladder of effectiveness, may be ready to 
cope with their problems, provided they are given a good deal of 
direction b} the couns :-or . Still others, with more self-con- 
fidence, more experience, may be ready to accept the responsibility 

for defining goals, for trying to apply new ideas which the coun- 
selor would teach. 

Summary 

The purpose of the present study was to take a beginning 
step toward the goals of a) working out a method of conducting 
naturalistic counseling interviews while controlling counselor 
behavior, and b) of building the necessary instrumentation to 
measure the effectiveness of different modes of counseling. While 
each goal was only partially achieved, the results are encouraging. 
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They indicate that the counselors were sufficiently able to adhere 
to the defined modes, that each mode was differentiated from the 
others, and that within each mode, there was relatively little 
intrusion of non mode-defined behavior. Also, from their reactions 
it was evident that the counselees experienced the interviews as 
serious attempts to help them deal with real problems. Further- 
more, this research shows that the different modes of counselor 
behavior do indeed have different results, and that counselee 
characteristics will influence how an individual will respond to 
a particular method of counseling. The "Advisory" mode, for 
example, seems more likely to make people feel better, and the 
"Inquiry" mode seems more likely to change their behavior. The 
person with more self - initiative seems to prefer the "Inquiry" 
mode, while the one who feels helpless and impotent seems to pre- 
fer to have solutions provided, as in the "Advisory" mode. These 
conclusions are still largely intuitive, but they are partially 
supported and the findings give us no reason to reject them. 
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